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Abstract 

We study the replica free energy surface for a spin glass model near the 
glassy temperature. In this model the simplicity of the equilibrium solution 
hides non trivial metastable saddle points. By means of the stability analysis 
performed for one and two real replicas constrained, an interpretation for some 
of them is achieved. 







1 Introduction 



In spin glass models, replica symmetry breaking implies the existence of many pure 
states of equilibrium. Their hierarchical organisation is described by the order pa- 
rameter Q a b 0. In the SK model Q a b has a continuum form and it is a marginally 
stable saddle point of the replica free energy surface in the limit n — > 0. In other 
models, like the p-spin spherical model, the stable solution is just one-step, yielding 
a simpler equilibrium state organisation ||. 

In this paper we investigate this different feature from the stability point of 
view. We use the generalisation of the replica method recently developed to study 
non equilibrium states M ||. The general idea is to consider R identical copies of 
the model (real replicas) constrained to have specific mutual overlaps. Then, by 
forcing the overlaps out of equilibrium, one can probe the phase-space structure of 
the original model and obtain information on some of its non equilibrium states. 

By performing the stability analysis in the replica approach off equilibrium, we 
uncover the physical meaning for some saddle points other than the one yielding the 
Gibbs-measure results. 



2 The unconstrained model and its saddle points 
2.1 The model 

Let us consider the following truncated replica free energy density 

F{Q) = ~(t TrQ 2 + l -TrQ* + + &) « 

where we consider t ~ T c — T to be small. The cubic term Y^Qabi absent in the 
SK-model, gives a y independent replica symmetry breaking. A term of this kind 
appears in the p-spin spherical model and in the Potts model ||. The y parameter 
will play the role of a control parameter. We will assume it to be small (y << t) 
but positive or negative (in the SK model it is positive). 

In || it was shown that for y < the stable solution is simply a matrix with 
one replica symmetry breaking (1RSB). The probability distribution of the overlap 
between equilibrium configurations is then 

P eq (q) = m 1 8{q) + (1 - m 1 )8{q - q EA ) (2) 
where qEA — 2t + ^-yt 2 and mi = | + yt are obtained by stationary conditions. 
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In the solution we will consistently truncate the 0(y 2 ) terms. As a consequence 
of the stationary conditions, the 0(y 2 ) terms in the solution give 0(y 4 ) contribution 
to free energy. In the following we will then consider free energy up to 0(y 3 ). 

2.2 Unstable saddle points 

For positive y we know that a better approximation to the full solution is given by 
the 2RSB saddle point 



and free energy F 2RS b > F 1RSB {F 2RS b - Fi RSB ~ y 2 )- 

To study fluctuations around this 2RSB S.P. we consider the eigenvalue equation 



where / = Q — Qsp- This equation, analysed in details in the context of the 
SK model J7|, can be solved through the explicit construction of the eigenvectors 
exploiting the symmetry of the equation. In the notation of |7| the eigenvectors are 
classified as longitudinal (fab), anomalous (fab) an d replicon (f^). For positive y 
the minimum eigenvalue is A = — ^- and it is well known that unstable directions 
belong also to the replicon family. 

Let us discuss the analytic continuation to negative y of this solution, that we 
expect to have new unstable directions. It leads to m-i < mi, a result which does 
not allow the usual probabilistic interpretation. 

We found the minimum eigenvalue to be negative (A = -^-). The unstable 
eigenvectors belong to the longitudinal and anomalous families. They are 




< x < mi 
nil < x < ni2 
ni2 < x < 1 



(3) 



(2t + q ab + yq 2 ab + X)f ab + {Q, f}ab = 



(4) 



longitudinal —> f a b 
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anomalous — > f^ b 
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max(a C\ fi,bf\ fi) = 
max(a PI /i, 6 D /x) = 
max (a PI & D /i) > 
maxia PI 6 D /i) > 



(5) 



where, as in , a H £» = if g a& = 

For future reference, we anticipate that by considering additional RSB the new 
unstable S.P. will have mj+i — m; ~ y. There is, of course, the analytic continua- 
tion (to negative y) of the continuum solution (slope = ^), which is the only one 
marginally stable for positive y. It has obviously a free energy greater than the other 
solutions. 



3 The constrained model 

Let us consider R Real Replicas and introduce in the partition function §(R — 1) 
complex Lagrangean multipliers (e rs ) to keep the mutual overlaps constrained (q r c 
The effective averaged free energy has two contributions M 



fc) 



F R (Q,q, 



c J 



F(Q)+F constr (C,Q r c s ) (6) 

The functional F(Q) has the same form as for a single real replica with Q a 
Rn x Rn matrix 



Q = 


( Q u 

pl2 T 


pl2 

Q 22 '. 


plR, 
p2R 




[p 1rT 


p2R T 


".. Q RR ) 



where 



e°°. The "interaction" term F constr {e r ^, q r c s ) reads 



W ( c rs n rs \ ■ 

r constr{t a i He ) " 

The stationary conditions are then 
dF dF 



dq r J, 



dp' a 



BF 

^ = 



(7) 



ab 



dp, 



rs 
eta 



(9) 
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In the following we consider the particular case R = 2 and we make for Q and 
P a Parisi ansatz. Before analysing the solution, let us explain how we studied the 
stability. 



3.1 2RR Stability 



To study the Hessian of F 2 we consider F at fixed p aa = pd- From @ we see that 
the saddle point for p aa , which originally is integrated along the imaginary axis, 
lies then on the real axis. The integration path can be deformed to go through the 
saddle point but the integration path will be perpendicular to the real axis. This 
S.P. has to a maximum when compared to values along the integration path. Notice 
that this distinguish pd from all other matrix terms which are integrated along the 
real axis. The stability with respect to pd fluctuations around the saddle point can 
be then verified in (§) and, being not proportional to t, decouples. 
The equation for F 2 is then 



where aj3 = 1, 2n but a— (3 ^ n. In order to reduce this problem to an ultrametric 
one we can observe that the symmetry group of the Hamiltonian without constraint 
is S2n (all replicas are equivalent). After imposing the constraint it becomes S n (g> 
(S^) 8 " 1 (to permute simultaneasly replicas in both systems or to permute equivalent 
replicas between systems). Since all solutions found are symmetrical under the 
action of 5*2 on all the replicas, we divide the eigenvectors in two superfamilies, 
the symmetrical and the antisymmetrical one. We then parametrise the fluctuation 
matrix f around the Qs.p. i n terms of 



(2t + q Q/3 + yqlp + A)f a/3 + {Q, f } a(3 = 



(10) 




(11) 



where the f l > x ' z are n*n symmetrical matrices and f y antisymmetrical 
The eigenvalue equations are now decoupled and read, for a ^ b, 



(2t + q ab + yq 2 ab + \)f l ab + {Q, /% + {/*, P} ab 
(2t + p ab + yp 2 ab + A)/J + {P, fU + {f x , Q} ab 











(12) 



and 



4 



(2t + q ab + yq 2 ab + X)f: b + {Q,f z U + [fy,P} ab = 

(2t + p ab + yp 2 ab + X)f ab + {Qjy} ab + [r,P} ab = (13) 

The eigenvectors of (O) and ( pT3|) are then respectively of the form 



( + ^ 

V +r 



+/ 1 



+fi 



+fl 



+ f x 



+ f x 

+fl 



(14) 



[IV 



+f 2 









_ fy 

J a 



~f Z 
J [i 



(+f, 



UIJ 



'■fll/ 



\ -fy -f 



(15) 



where ft and are antisymmetrical matrices breaking the hierarchical subgroups 
of permutation group (as the 1RR ones). 



3.2 2RR constrained saddle points 

We investigate the possible 2RSB solutions in the range < pd < (Jea Pd = pW- We 
try to follow the solution by continuity when pd varies. At different points in the 
interval a stable solution becomes unstable and we have to search for the new stable 
solution. 

Let us consider y < 0. We find four critical pd values < p A < p B < p c < 
P D < Qea- At each critical pd value, two different solutions coincide and zero modes 
appear to modify their stability. 

We start at pd — 0. The stable solution is 




< x < m 2 
-■ 2t + fyt 2 m 2 < x < 1 

< x < m 2 

?7l2 < X < 1 



(16) 
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F 0A _ punconstr = Ap 0A = J_(_ 2 ^ p 2 - rf) + (y 4 ) (17) 

If = the free energy is the same as the equilibrium one and 9 q° A = = 0. 
For small pd the free energy is an increasing function of pd (fig .[!]). The minimum 
eigenvalue is A = — \yt 2 — Pd- Thus when Pd > p A = — \yt 2 this solution becomes 
unstable and the new stable solution is: 



< x < mi 

q(x) = \ qi= Pd~ ^yt(p d -t) mi < x <m 2 



2t + fyt 2 - \yp d {.Pd ~ 4t) m 2 < x < 1 

< x < mi 



mi 




p(x) = { Pi= p d - lyt(pd -t) mi < x <m 2 

m 2 < x < 1 



Pd 

■f y\i -i- 

The free energy is 



m 2 = ^ + y(t + Y^ 



^F AB = ^(2p d t* - 2pY + pit 2 - ip*f) + 0(y 3 ) (19) 

This solution crosses, at p d = p 1 , the previous one. For pd ~ — 2/ the minimum 
eigenvalue is A = y + As can be seen in (fig.[l]) and (figj^), AF AB is an increasing 
function until pd = p ma x — t + j^yt 2 , where = 9 g p B = 0. For future reference 
we rewrite ([18]) on this specific value 



< x < mi 
q(x) = I qi = t + f§2/£ 2 mi < x < m 2 



p(x) 




m 2 < x < 1 

< x < mi 
mi < x < 1 



nil = 

m 2 = ^ + y^~ (20) 
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The minimum eigenvalue is A = — As pd increases further, AF begins to 
decrease while all eigenvalues read positive until the second critical value p B . The 
minimum eigenvalue for p d ~ p B is A = —y{j>\ — 8pdt + 8t 2 )/6 and it corresponds to 
fluctuations of qi and p\. p B is defined by A| p s = 0. 

For pd greater than p B the stable solution becomes 



q = < x < mi 

q(x) = { qi= p d - \y{-p 2 d + 14p d t - Ut 2 ) m 1 <x <m 2 
= 2t + yft 2 - *f{p d - At) m 2 <x<l 

, = < x < mi 

p(x) = { pi = p d - \y(p 2 d - 2pdt + It 2 ) mi < x <m 2 
= Pd m 2 < x < 1 

1 . Pd 
mi = - + y- 

m 2 = \ + y(t + j) (21) 

The free energy of this solution (AF BC ), which differs from fll8f ) by terms of 
0(y 3 ), is decrasing in p d (fig^D- Again at pd = p B the two solutions crosses each 
other. The minimum eigenvalue is A = y{p 2 d — 8pdt + 8t 2 )/6. We have P\ — q\ — 



-2y{p\ - 8pdt + 8t 2 )/9 ~ A and the free energy difference between (^) and (|2~T1) , 
expressed in terms of reads ~ (pi — ql) 3 ~ —y 3 . 

We found (^l|) to be stable for p B < pd < p° — 3/21 In the range p c < pd < 
P D < qEA we did'nt find any 2RSB stable solution. In particular ( pT|) is unstable 
with respect to replicon fluctuations. We expect that additional RSB lead to the 
stable solution. 

Thus, let us consider p d > p D = 2t + ^f-. The stable solution is 



, v JO < x < mi 

q{X) ~ { l(Pd + t) + y§(p d + t) 2 mi<x<l 
p(x) = q(x) 

mi = \ + y\{Pd + t) (22) 
4 o 

The free energy, expressed in term of 5 = pd — qEA ~ y, reads (fig.||) 

AF Dg EA = ]_(_ 25 2 t 2 y _ 5 3) + (23) 

18 

and the minimum eigenvalue is A = 45 ~ 2yt . 
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Clearly for positive y these solutions are just approximations to the full solution. 
In particular we found (20) to have the same instability than the 2RSB free solution 



4 Discussions 

Let us analyse the previous results. For p d = the two real replicas lie on configu- 
rations belonging to different equilibrium states. As the multiplicity of pure states 
give no contributions to the entropy, the free energy per replica is equal to that of 
the unconstrained system and q(x) = q^ x ^ unconstr and p(x) = 0. IF pd increases 
we force the overlap between couple of replicas to be out of equilibrium. The free 
energy increases until the maximum is reached at p max while if pd > p max the free 
energy falls until pd of order of qEAi where we are choosing configurations inside the 
same state. Since the overwhelming majority of pairs of configurations inside a state 
are at distance qEA from each other, if pd = (Jea we have twice the energy and twice 
the intra-state entropy. 

At pd = p max we have d g ^ = d ^ = 0. The constraining force is then zero (on 
the S.P.) and the 2 real replicas are unconstrained. In fact the solution (p0|) is related 
through a replica permutation to the solution (|3|), because m1 RR = m\ RR /2. Then 
Fmax = FIrsb- However the constraint still acts on the fluctuations and prevents 
the 2 replicas from sliding along the unstable direction. 

It is remarkable that in this way we have been able to interpret an unstable 
2RSB. We conjecture that with more constraints one will be able to stabilise solu- 
tions with more levels of breaking. Therefore the linear solution, which is the limit 
for an infinite number of breakings, will reappear. 

The Parisi parameter q(x) plays two different roles in the SK model. On the 
one hand it appears in the Gibbs measure and determines the P eq (q). In this case 
q(x) must be necessarily monotonous. On the other hand x(q) also appears in the 
Cavity Method where monotonicity does not seem to be required. It remains as an 
intriguing open question whether in systems as the present a non monotonous x(q) 
could be relevant. Perhaps solving the R real replicas by a generalisation of the 
Cavity Method could elucidate this issue. 
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Figure 1: AF as a function of p d plotted for < p d < 2p A , t = 0.05 and y = —0.01. 



Figure 2: AF as a function of p d plotted for < p d < q E A, t = 0.05 and y = —0.01. 



Figure 3: AF as a function of p d plotted for p D near q EA , t = 0.05 and y = —0.01. 
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